Maybe if the inner diameter was different or the surface of washer has a different texture it would create different amounts of drag on the bolt head or nut, but my pea brain doesnt have the capacity to see how the outer diameter would change anything. The washers should not be moving when setting the torque.